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^ ■ Abstract 

In this paper we provide an achievable rate region for the discrete memoryless multiple access channel with 
' correlated state information known non-causally at the encoders using a random binning technique. This result is 

^ ' a generalization of the random binning technique used by Gel'fand and Pinsker for the problem with non-causal 

channel state information at the encoder in point to point communication. 
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I. The Problem Setup 

We consider a discrete memoryless multiple access channel (MAC) with two correlated states each known by 
one of the encoders. Specifically, we assume the following model: 

P{y\xi,X2,si,S2) and P(si,S2), (1) 

where si G Si and S2 G ^2 are known non-causally at encoder 1 and encoder 2, respectively. The channel inputs 
are xi G Xi and X2 G X2, and the channel output is y G 3^. The memoryless channel implies that 

n 

P(y|xi,X2, 81,82) = WP{yi\xii,X2i,Sii,S2i). (2) 
i=l 

The first user transmits the message nii G {l,...,Mi}, and the second user transmits the message 7712 G 
{!,... ,M2}, where mi and 7712 are independent random variables with uniform distributions, and Mi = 2"^\ 
M2 = 2"^^ . The first encoder observes the channel state information non-causally and generates the transmitted 
codeword 

0i:{l,...,Mi}x5r^;fr. (3) 



In the same way, the second encoder generates the transmitted codeword 

02:{l,...,M2}x52"^;f^. (4) 
The decoder uses the following mapping to reconstruct the transmitted messages 

V^: 3^" ^{l,...,Mi}x {!,..., M2}, (5) 
i.e., (rfii,rri2) = V'(y)- The error probability is defined as 

Pi") ^Pr(v(y) / (rni,m2)). (6) 



II. Main Result 

In the following theorem we provide an inner bound for the capacity region of O which is derived using a 
generalization of the random binning technique [1]. 

Theorem 1. An inner bound for the capacity region of ([U is given by 

n = cl conv |(iii,i?2) -Ri < I{U;Y\V) - I{U\Si\V) 

R2<I{V\Y\U)-I{V-S2\U) (7) 
Ri + R2< I{U, V- Y) - I{U, V; 5i, 52) 

for some admissible pair {U, V) ^ 

where the admissible pairs satisfy: 

P{U,V,Xi,X2,Si,S2,Y) = P{Si,S2)PiU,Xi\Si)P{V,X2\S2)P{Y\Xi,X2,Si,S2). (8) 

The theorem implies that the following two Markov chains are satisfied: 

{U,Xi)^Si^S2^{V,X2) (9) 
{U,V)^iXi,X2,Si,S2)^Y. (10) 

Proof: We denote the set of e-typical of two n-sequences a and b where Oj G A, 6j S i? for z = 1, . . . , n by 
A^J^\a,B) (we use the same notation as in [2]). 

Fix the distributions P{U,Xi\Si) and P{V,X2\S2). Calculate the marginal distributions P{U) and P{V). 
• Codebooks generation: Let 

j^ = 2^inV;S,)+Ae]^ (12) 

Codebook 1: Generate 2"("^i+^^) of independent sequences of length n, generating each element i.i.d 
according to distribution Yli=i ^(^i)' ^^'^ distribute these sequences randomly among Mi bins where each 
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bin has 2"'^i sequences. 

Codebook 2: Generate 2"("^^"''^^) of independent sequences of length n, generating each element i.i.d 
according to distribution HILi P{vi), and distribute these sequences randomly among M2 bins where each 
bin has 2"'^^ sequences. 

• Encoder of user 1: Given the state sequence si and the message mi, search in bin mi of codebook 1 for a 
u sequence such that (u, si) G A^{U, Si). Send xi which is jointly typical with u and si, i.e., (u, si,xi) € 
A^{U,Si,Xi) 

• Encoder of user 2: Given the state sequence S2 and the message 7712, search in bin m2 of codebook 2 for a 
V sequence such that (v, S2) G A'^{V,S2)- Send X2 which is jointly typical with v and S2, i.e., (v,S2,X2) G 
A^iU,S2,X2) 

• Decoder: Given the received vector y, search for unique sequences u and v such that (u, v, y) G A^{U, V, Y). 
Analysis of the error probability: The error probability is given by 

^'i"^= E ^5r,5j(si,S2)+ i'5r,5j(si,S2)P(e|si,S2) 



Si,S2^Ai"'(S'l,S2) 



si,S26A<"'(5i,52) 



<e+ X] -P5r,52"(si,S2)P(e|si,S2), 

Si,S2eAi"'(5l,S2) 

where the inequality follows the asymptotic equipartition property (AEP) [2]. Hence, we need to evaluate only the 
second term. We define the following error events for specific sate sequences (si,S2) : 

. ^i(si,mi) = ji, 1 < ji < Ji : (u„,,i,,si) G At\u,Si)}. 

. ^2(s2,m2) = {t J2, 1 < J2 < J2 : (v™,2,i2,S2) G At\V,S2)}. 

. £;3(si,S2,mi,m2) = {(U„^,ii(si,mi)' Vm2,i2(s2,m2)'Sl'S2) ^ At\U ,V, Si, S2)} ■ 

• £'4(81,82,7711,7712) = {{yi-mi,ji{sx,mi)-,^m2,j2{s2,m2)->y) 

. £5(81,82,7^71,7712) = {3u„;j^ : 7711 / 777'^, (u.;„;j^,Vm2,j2>y) ^ At\U,V,Y)]. 
. £'6(Sl,82,7f7i,7R2) = {Bv^^j^ : 7772 / m'2, (u^i ,ji , v^^ , y) G A^"^ (ij, F ) }. 
. £7(81,82,7771,7^2) = {3um;,ji, Vrn^j^ : 7771 / 777^,7r72 / 777'2, (u^; ji , v^^ , y) G A^"^ (f/, V, F ) }. 
Then by union bound, the error probability is upper bounded by 
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e + 



M1M2 

mi ,m2 

+ Pr(£3(8i,82,7rai, 7772) 
+ Pr(£4(8l, 82, 7771, 7772) 
+ Pr(£5(8i,82,7rai,7ra2) 
+ Pr(£6(8i, 82, 7771, 7772) 
+ Pr(£7(8i, 82, 7771, 7772) 



PS^,SS{S1,S2) Pr(£l(8i,777l)) + Pr(£2(82,7772)) 



|£l(si, 777i), £2(82, 7772)) 
|£3(8l82, 7771, 7772)) 
|£3(8i82, 7771, 7772)) 
|£3(8i82, 7771, 7772)) 
[£3(81, 82, 7771, 7772)) 



(13) 



We now evaluate the probability of each error events. For independent u and si the probability that (u, si) € 
A^{U,Si) is bounded below by 

Pr((u,si)e^^(C/,5i))= Yl P(.^)Pi^i) 

(u,si)eA?(;7,Si) 

> 2nlHiU,Si)~e]2-nlHiU)+e]2~n[H(Si)+e\ 
^ 2-"[^(^)+^(-^i)--f^('^.-5'i)+3e] 
^ 2~nlIiU;Si)+3e] 



Hence, we have that 

Ji 



Pr(Ei(si,mi)) < 



1 _ 2-"[^{^;-5i)+3e] 



(14) 



< exp (^_j,2-"I^(^'^0+3.] j (15) 

= exp(-2"^), (16) 

where (fTSl ) follows since 1 — x < exp(— x). Hence, this term decays to zero as n — > oo. In the same way 
Pr(i?2(s2, "22)) goes to zero as n — > 00. 

Provided that £'i(si,mi) and £2(82,1712) have not occurred, i.e., (umiji,si) G A^e^\u, Si) and (vmajai^z) S 
Ai''\v, S2), from Markov Lemma [2] we have that 

Pr((u,v,si,S2) G 4")(f/,y,5i,52)|(u,si) G (v, S2) € 4")(y,S2)) > 1 - e (17) 

where the typical set Ai"'\u, V, Si, S2) is associated with the joint distribution 

P{U, V, Si,S2) = P{Si, S2)P{U\Si)P{V\S2). (18) 

Hence, we have that 

Pr(£;3(si,S2,mi,m2)|-Ei(si,mi),^2(s2,n22) < e (19) 

In fact, we have (with high probabihty) that the sequences (umiji, Vmajai^ij^a) generated using the joint distri- 
bution ([TS] ). which is equivalent to the Markov chain U ^ Si ^ S2 V. 

Provided that £'3(81, S2, mi, 1112) has not occurred, from the AEP we have that 

Pr (£'4 (si , S2 , mi , 7712 ) I £3 (si , S2 , mi , 7712)) 

= Pr((u,v,y) ^^W(C/,y,y)|(u,si)G^W(C/,5i),(v,S2)GAW(y,52)) 
< e. 



Likewise, we have that 



Pr(£;5(si, S2, mi, m2)|^3(si, S2, mi, 7722)) (20) 
< MiJiPr((u„,j,,v^„,„y) G Ai^^{U,V,Y)) (21) 
= MiJi Yl P(u)p(v,y) (22) 



(u,v,y)GA<"'((7,y,y) 



< A/i Ji|4"Hf/, V, y)|2-"[^^(^)-^l2-"[^(^'^)-^l (23) 

^ 2nR,2n[I{U;Si)+4e]2-n[H(U)+H{V,Y)-H{U,V,Y)-3e] ^24) 

^ 2*^-^1 2'^[-'^('^''^i)+^^l2~"[-'^*^'^'^''^^~^''] (25) 

^ 2^nRi2nlHU;Si)+'it]2-n[I{U;V)+I{U;Y\V)-3e] ^26) 

^ 2"^i2~"['^('^'^l^)+-^('^'^)"-^('^''^i)"''^l (27) 

^ 2nRi2-'n'[I{U;Y\V)-H{U\V)+H{U\Si)-7e] (-28) 

^ 2"-f^i2~"[-'^(^''^l^)~-'^('^l^)+-'^('^l'^i'^)~'''''] (29) 

^ 2"^i2-"[^(^''*^l^)--^('^'*'il^)-'^^l, (30) 

where ( |23] ) and (l24l ) follow from AEP; (|26l ) follows from the chain rule for mutual information; (|29l ) follows from 
the Markov chain U ^ Si V. In the same way, it can be shown that 

Pr(£;6(si,S2,mi,m2)|E3(si,S2,mi,m2)) < 2"^=2~"[^(^;^l^)-^(^'^=l^)-^^l (31) 



Furthermore, 



Pr(£;7(si, S2, mi, m2)|£'3(si, S2, mi, m2)) (32) 

< MiM2JiJ2Pr((u^;j,,v„.,,,,y) G Ai^\u,V,Y)) (33) 

= MiM2JiJ2 Yl P(u)P(v)P(y) (34) 

(u,v,y)GA<"'(c/,y,y) 

< MiM2JiJ2|4"^(^7,F,y)|2-"[-^(^)-^]2-"[-^(^)"^l2-"[^(^)-^l (35) 
= M1M2J1 J22"[^(^'^'^)-^l2-"[^(^)+^(^)+^(^)-3^] (36) 

U,V,Y)~M (.37) 

(38) 
(39) 
(40) 
(41) 
(42) 
(43) 



^ 2n[Ri+R2 


2" 


[/(f/;5i)+4e]2n[/(y;52)+4e]2-n[H{C/)+H(y)+//(y) 


2n[Ri+R2 


2" 


[/(f/;5i)+/(y;52)+8e]2-n[/(C/,y;y)+/(C/;y)-3e] 


2n[Ri+R2 


2" 


~n[/(C/,y;Y)-/(C/;5i)-/(y;52)+i'((7;F)-lle] 


2n[Ri+R2 


2" 


■-n[/((7,y;y)+/i'(f/|Si)-/i'{C/|yi)--/(y;52)-lle] 


_ 2^[Ri+R2 


2" 


■-n[I{U,V:Y)+H{U\Si,S2,V)-H{U\V)-I{V;S2)-lle] 


2n[Ri+R2 


2" 


-n[I{U,V;Y)-I{U;Si,S2\V)-I{V;Si,S2)-lle] 


2n[Ri+R2 


2" 


■-n[I{U,V:Y)-I{U,V;Si,S2)-lle] 
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where dH) and dm follow from AEP; (|4T]) follows from the Markov chain U ^ Si ^ S2 ^ V; dH) follows 
from the chain rule for mutual information. 

The theorem follows from (l30l) . (|3TI) . d43]) . since for any arbitrary e > the conditions in dZj imply that Pi"'' 

as n ^ 00. □ 

III. Special Cases 

We consider now two special cases of the memoryless MAC with correlated state information known non-causally 
at the encoders. The first case is for Si = S2, i.e., the relation between the states is deterministic. The second case 
is for independent states. 

I. Single state: in this case we have single state which is known to both encoders, i.e., S = Si = S2, the 
achievable rate region is given by 

n = d conv |(i2i,i?2) --Ri < IiU;Y\V) - I{U;S\V) 

R2<I{V;Y\U)-I{V;S\U) (44) 
Ri + R2< HU, V; Y) - I{U, V; S) 

for some admissible pair ([/, V) | 

where the admissible pairs satisfy: {U,Xi) <-> 5* <-5' {V,X2), and {U,V) <-> {Xi, X2, S) <-> Y. 
The Gaussian case of single interference is given by 

Y = Xi+X2 + S + Z, (45) 

where Z '-^ A/'(0, N), the interference S is known non-causally to user 1 and user 2, and the power constraints 
are Pi and P2 for user 1 and user 2, respectively. This model was considered by Gel'fand and Pinsker [3]. 
It was shown that the capacity region is equal to clean MAC, i.e., for the case that 5 = 0. In this case, the 
region in d44l ) concises with the clean MAC region [2]. 
II. Independent states: for the case that and ^2 are independent, the achievable region becomes 

n = d conv |(-Ri,P2) : Ri < I{U;Y\V) - I{U; Si) 

R2<I{y;Y\U)-I{V-S2) (46) 
Ri + R2< I{U, V; Y) - I{U; Si) - I{V, S2) 

for some admissible pair {U, V) ^ 

where the admissible pairs satisfy: {U, Si,Xi) is independent of {V, S2, X2), and {U, V) ^ {Xi,X2, Si, S2) ^ 
Y. The case with independent channel states was originally considered in [4], which also introduces the rate 
region in d46ll . 
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